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Abstract 

We study the integral and measure theory of the ultraproduct of finite sets. As a main 
application we construct limit objects for hypergraph sequences. We give a new proof for 
the Hypergraph Removal Lemma and the Hypergraph Regularity Lemma. 
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1 Introduction 



The so-called Hypergraph Regularity Lemma (Rodl-Skokan [5], Gowers [5], later generalized 
by Tao is one of the most exciting result in modern combinatorics. It exists in many 
different forms, strength and generality. The main message in all of them is that every 
fc-uniform hypergraph can be approximated by a structure which consists of boundedly 
many random-looking (quasi-random) parts for any given error e. Another common feature 
of these theorems is that they all come with a corresponding counting lemma [E\ which 
describes how to estimate the frequency of a given small hypergraph from the quasi-random 
approximation of a large hypergraph. One of the most important applications of this method 
is that it implies the Hypergraph Removal Lemma (first proved by Nagle, Rodl and Schacht 
[S]) and by an observation of Solymosi [10 it also implies Szemeredi's celebrated theorem on 
arithmetic progressions in dense subsets of the integers even in a multidimensional setting. 

In this paper we present an analytic approach to the subject. First, for any given 
sequence of hypergraphs we associate the so-called ultralimit hypergraph, which is a mea- 
surable hypergraph in a large (non-separable) probability measure space. The ultralimit 
method enables us to convert theorems of finite combinatorics to measure theoretic state- 
ments on our ultralimit space. In the second step, using separable approximations we trans- 
lates these measure-theoretic theorems to well-known results on the more familiar Lebesgue 
spaces. This way in two steps we prove the Hypergraph Removal Lemma from the Lebesgue 
Density Theorem and the Hypergraph Regularity Lemma from the Rectangular Approxi- 
mation Lemma of Lebesgue Spaces. 

We also construct a Hypergraph Limit Object to convergent hypergraph sequences directly 
from the ultralimit hypergraph. This construction is the generalization of the limit graph 
method [I], [5] where limits of sequences of dense graphs are studied. According to a defi- 
nition by Borgs et. al. pi a graph sequence is called convergent if the density of any fixed 
graph in the terms of the sequence is convergent. In a paper by Lovasz and Szegedy [6] 
it is shown that a convergent graph sequence has a natural limit object which is a two 
variable function w : [0,1]^ — ^ [0; 1] with w{x,y) — w{y,x). Informally speaking, w is an 
infinite analogue of the adjacency matrix. Our main theorem is a generalization of this 
theorem to fc-uniform hypergraphs. We also show that limits of fc-uniform hypergraphs can 
be represented by 2^^ — 2 variable measurable functions w : [0, 1]^ ^ [0, 1] such that the 
coordinates are indexed by the proper non empty subsets of {1, 2, . . . , fc} and w is invariant 
under the induced action of Sk on the coordinates. 

Acknowledgement: We are very indebted to Terence Tao and Laszlo Lovasz for helpful 
discussions. 
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2 Analysis on the ultraproduct of finite measure spaces 
2.1 Ultraproducts of finite sets 

First we recall the ultraproduct construction of finite probability measure spaces (see [5]). 
Let {Xi}°^^ be finite sets. We always suppose that \Xi\ < \X2\ < {X^l < . . . Let w be a 
nonprincipal ultrafilter and lini^^ : 1°°{N) — > R be the corresponding ultralimit. Recall that 
lim^^ is a bounded linear functional such that for any e > and {a„}J^2 ^ ^°°(N) 

{i G N I fli G [lim a„ — e, lim a„ + e] } G w . 

UJ UJ 

The ultraproduct of the sets Xi is defined as follows. 

Let X = Yl°^iXi. We say that p = {pi}'^i,q = {qi}iZi ^ ^ ^^'^ equivalent, p ~ g, if 

{i G N I = g j G w . 

Define X := X / r^. Now let 'P{Xi) denote the Boolean-algebra of subsets of Xi, with the 
normalized measure /i^ (A) = ^ . Then let V = n^^^i ^(^0 and V = P/I, where / is the 
ideal of elements {Ai}°^^ such that {i G N | = 0} G w . Notice that the elements of V 
can be identified with certain subsets of X: If 

P = [{Pi\Zi] G X and A - [{A^]T=i] e V 
then p G 3 if {i G N I K G A,} G w . Clearly, if A = [{A,},^i], S = [{B,}°^^] then 

. AUB=[{A,UB,}^,], 

. AnB=[{A,nB,}fl^]. 

That is 7-" is a Boolean algebra on X. Now let n{A) — limi^ iJ,i{Ai). Then jj, : V ^ R is a 
finitely additive probability measure. 

Definition 2.1 N C X_ is a nullset if for any e > there exists a set A^ ^ V such that 
N <Z A^ and fi{A^) < e. The set of nullsets is denoted by J\f. 

Proposition 2.1 J\f satisfies the following properties: 

• ifNeAfandMC N, then M G Af. 

• {-/Vfclfc^i are elements of Af then U^j^A^fe G J\f as well. 
Proof. We need the following lemma. 

Lemma 2.1 If {A^}'^^ are elements ofV and lim;^oo l^{^k=i'^k) — t then there exists an 
element B E V such that fi{B) — t and Ak C B for all fc G N. 
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Proof. Let Bi = U^^^Ak, fJ.{Bi) = U, lim;^oo U = t . Let 

where = [{Afe}»=i] ■ Observe that Ti e ui. Hie n^^T; but i i T„+i, then let 
= U^^^A^ AiieTi for all / £ N, then clearly M»(U^iA^.) = i and we set C, := U^^A*^ . 
Let S := [{C,},^i] . Then /Lt(B) = t and for any fc G N: 3^ C B. I 

Now suppose that for any j > 1, G M . Let G T' such that C and < e^- 

Then by the previous lemma, there exists i?*^ G P such that for any > 1 -Bj- C i?*^ and 
fJ-{B'^) < e. Since U^^j^Aj C B*^ , our proposition follows. I 

Definition 2.2 WTe ca/Z B C X a measureable set if there exists B G V such that 
BAB G TV. 

Theorem 1 The measurable sets form a a-algebra and n{B) — ^{B) defines a proba- 
bility measure on B^j. 

Proof. We call two measurable sets B and B' equivalent, B = B' \i BAB' G N . Clearly, 
if A ^ A', B ^ B' then A'^- ^ {A'f, A\J B ^ A' \J B' , Ar\ B ^ A' r\ B' . Also if A, B G P 
and A^ B, then = fJ.{B). That is the measurable sets form a Boolean algebra with a 
finitely additive measure. Hence it is enough to prove that ii Ak & P are disjoint sets, then 
there exists A ^ V such that U^j^Afc = A and ij,(A) — J2T=i ^(^fc) ■ Note that by Lemma 
O there exists AeV such that fi(A) = J2k=i f^i^) and H C 3 for all A: > 1. Then for 
any j > 1, 

A\ u^^i a;ca\ ui^i A^eV. 

Since lim^^oo ti(A\ U^^^ A^) = 0, A\ G A/" thus U^^^ = A I 

Hence we constructed an atomless probability measure space (X., B^, Note that this 
space is non-separable, that is it is not measurably equivalent to the interval with the 
Lebesgue measure. 

2.2 Measureable functions and their integrals 

Let {Xi}°l^ be finite sets as in the previous section and fi : Xi ^ [~d,d] be real functions, 
where d > 0. Then one can define a function / : X ^ [— d, d] whose value at p = is 
the ultralimit of {fi{pi)}^i. We say that / is the ultralimit of the functions {/ij^i- From 
now on we call such bounded functions ultralimit functions. 
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Lemma 2.2 The ultralimit functions are measurable on X and 



L 



J., ,. SpeXj /iW 
fdn = hm — 



Proof. Let —d < a < b < dhe real numbers. It is enough to prove that f[a,b] = {p G X | 
a < f{p) < b} is measurable. Let /j^ = {p € X, \ a < f^{p) < b} . Note that [{/[^^ftjj.'^^i] is 
not necessarily equal to f[a,b] ■ Nevertheless if 

then Pn & V and /[a^hj = n^]^P„. This shows that f[a,b] is a measurable set. Hence the 
function / is measurable. Now we prove the integral formula. Let us consider the function 
Qi on Xi which takes the value ^ if takes a value not greater than ^ but less than 
for -Nk <j< Nk, where Nk = [rf2*^] + 1. Clearly | lim„ ffi - /| < ^ on X. Observe that 
g = lim^^ Qi is a measurable step-function on X taking the value ^ on Cj = [{/,% 
Hence, 



y_^ffd/. = lim J] 



\XA 2k 



Also, Iff — /I < ^ on X uniformly, that is \ J-^ f dfi — J-^ g d/i] < ^ . Notice that for any 
i > 1 

AT. \fi I „ . , , ^ 



< 



2fc • 



Therefore for each > 1, 



Thus our lemma follows. 



I 



f d\x — lim ■ 



< 



2k-i 



Theorem 2 For every measurable function / : X — > [— rf, rf], t/iere ea;ists a sequence of 
functions fi : Xi ^ [—d,d] such that the ultralimit of the sequence is almost every- 

where equals to f. That is any element o/Z/°°(X, jBa;,/i) can be represented by an ultralimit 
function. 

Proof. Recall a standard result of measure theory. If / is a bounded measurable function 
on X, then there exists a sequence of bounded stepfunctions {hk}'^i such that 

• f = YX=ihk 

• \hk\ < -2^, if fc > 1. 

• hk = X^^Li c^Xa^) where ^^n=i-^n = X is a measurable partition, G M if 1 < n < 
rik- 
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Now let B';^ e V such that fi{A'^AB^) = 0. We can suppose that U"^iB,^ is a partition of 
X. Let h'l^ = X^nli c^Xs^ and /' = X^fc^i ''-fe- Then clearly f = f almost everywhere. We 
show that /' is an ultralimit function. 

Let = [{Bt,}°gi]. We set Tfe C N as the set of inte gers i for which U"^i]^i?^ j is a partition 
of Then obviously, Tf. £ lj. Now we use our diagonalizing trick again. If i ^ Ti let 
Si = Q. li i e Ti,i e T2, . . . ,i e Tk,i T^+i then define Ej=i(I]"=i c^Xs^ .) • ^ 

i G Tfc for each k > 1 then set s, := J^^^ iJ2nU ^Xb^ ) • Now let p e Bj^nBln. . .H B^^ . 
Then 

|(lims.)(p)-/'(p)| <^. 
Since this inequality holds for each k > 1, f = lim^ Si. I 

2.3 Fubini's Theorem and the Integration Rule 

We fix a natural number k and we denote by [k] the set {1, 2, . . . , k}. Let Xi^i, Xi_2, ■ ■ ■ , Xi^k 
be k copies of the finite set Xi and for a subset A C {1, 2, . . . , fc} let Xi^A denote the direct 
product ®jf=A^iJ- Let X'^ denote the ultra product of the sets Xi,A, with a Boolean 
algebra Va- There is a natural map pA '■ X^'^'l X"^ (the projection). Let Ba be the 
cr-algebra of measurable subsets in X"^ as defined in the previous sections. Define cr{A) as 
P~^^{Ba), the cr-algebra of measurable sets depending only on the A-coordinates together 
with the probability measure /i^. For a nonempty subset A C [k] let A* denote the set 
system {B\B C A , \B\ = \A\ - 1} and let a{A)* denote the cr-algebra {a{B)\B e A*). An 
interesting fact is (as it will turn out in subsection 12. 4p that <j{A)* is strictly smaller than 
a{A). 

Lemma 2.3 Let A,B C_ [k] and let f : X^'^'l R be a bounded a (B) -measurable ultralimit 
function. Then for all y £ X'^ the function fy is a{A fl B)- measurable, where A'^ denotes 
the complement of A in [k] and fy{x) — f{x,y). 

Proof Let / : Xt'^l ^ R be a cr(_B)-measurable ultralimit function. It is easy to see 
that the finite approximation functions fi : Xi^i x Xi_2 x • . . Xi^k constructed in Theorem[5] 
depend only on the i?-coordinates, since cr(_B) -measurable functions can be approximated 
by CT(i3) -measurable stepfunctions. Let y G X"^"", y ~ Then fy is the ultralimit of 

the functions /f ' . Clearly f^^ depends only on the A n _B-coordinates, thus the ultralimit 
fy is a{A n _B) -measurable. I 

Theorem 3 (Fubini's Theorem) Let A C [k] and let f : Xk — > M &e a a {[k]) -measurable 
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ultralimit function. Then 

I fip)dti-lk]ip) ^ i fy{x)dnA{x)] duA-iy) 

Proof. Let / be the ultralimit of {fi : ^ijfe] — > M}^]^. Define the functions /,; : X^^^c 
[-d,d\ by 

xeXi,A 

By Lemma [22] 

/ f{x,y)d^iA{x). 
Jy^A 

Applying Lemma 12.21 again for the functions fi, we obtain that 

limlX^.A^r^ V ftiy) ^ (/ f{x,y)dfj.Aix)]dfiA-={y)- 

This completes the proof, since 



I 



Recall that if S C ,4 are cr-algebras on X with a measure fi and 5 is an ^-measurable 
function on X, then E(g \ B) is the ;B-measurable function (unique up to a zero measure 
perturbation) with the property that 



j^E{g I B)df,^ J^gdfi, 



for any Y e B (see Appendix). 

Theorem 4 (Integration Rule) Let gi : Xl'^l R be bounded a (Ai) -measurable func- 
tions for i — 1,2,..., 771. Let B denote the sigma algebra generated by a{Ai H A2), (t{Ai n 
A3),...,cr(Ai nA„). Then 

/ gi92 ■■■9m dfj.[k] = / E{gi\B)g2g5 . . . 5™ dfi[k] ■ 

Proof. We may suppose that all gi are ultralimit functions, since the conditional expectation 
does not depend on zero measure perturbation. Since gi does not depends on the A1 
coordinates we may suppose that E{gi \ B) does not depend on the A^-coordinates as well. 
By the previous theorem. 



919293 ■■■ gm dti[k] ^ (/ 9iix)92{x,y) ■ ■ ■9m{x,y)dfiAi{x)] duAiiy) ■ 

Jx^i VJx-*i / 
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Now we obtain by Lemma [2731 that for all y G Xai'= the function 

X g2{x,y)gz{x,y) . ..g„i{x,y) {x € Xa^) 
is _B-measurable. This means that 

gi(x)g2(x, y)... gm{x, y)d^iA^ {x) = 

E{gi\B){x)g2{x,y)g3{x,y) . . . gm{x,y)d^i.Ai{x) 



X-*i 



/X-*i 

for all y in X^c . This completes the proof. I 

Lemma 2.4 (Total Independence) Let Ai, A2, . . . Ar be the list of nonempty subsets of 
[k], and let Si, S2, ■ ■ ■ , Sr be subsets 0/ X!''! such that Si G cr{Ai) and E(Si\a{Ai)*) is a 
constant function for every 1 < i < r. Then 

ii{Si n 52 n . . . n 5,) = niSi)n{S2) . .-KSr). 

Proof. We can assume that \Ai\ > \Aj\ whenever j > i. Let Xi be the characteristic 
function of Si . We have that 



fi{Si n S'2 n . . . n 5r) = / xiX2 ■ ■ ■ Xrd^im 

Jxl"! 



The integration rule shows that 



XiX-i.+i ■ ■ ■ Xr dfi[k] = / E{Xi\cr{A^)*)xz+i---Xrd^[k] 
xw Jxi^i 

= KSi) I Xi+lXi+2 ■ ■ ■ Xr d^l[k]- 
JXl^l 

This completes the proof. I 
2.4 Random Partitions 

The goal of this section is to prove the following proposition. 

Proposition 2.2 Let A C [k] be a subset, then for any n > 1 there exists a partition 
= 5i U 5'2 U . . . U Sn, such that E{S^ \ <7{A)*) ^ i. 

Proof. The idea of the proof is that we consider random partitions of Xa and show 
that by probability one these partitions shall satisfy the property of our proposition. Let 
fl = Hi^iili 2, . . . , n}^' -* be the set of {1, 2, . . . , n}-valued functions on lJ°liXi A- Each 
element / of defines a partition of Xa the following way. Let 

sy = {pe x,,A I f{p) - j} 1 < J < z > 1 . 



[{sy}z^] = sj. 

Then XA = SjuSjU...US]^is our partition induced by /. 
Note that on O one has the usual Bernoulli probability measure P, 

where 

Tpi,P2,...,pAii,i2,---,ir) = {/ e n I f{ps) =is 1 < s < r}. 

A cylindric intersection set T in Xi,A is a set T = nc.ccATc, where Tc C Xi c- First 
of all note that the number of different dylindric intersection sets in Xi^A is not greater than 

CCCA 

Let < e < be a real number and T be a cylindric intersection sot of elements at least 
e|Xi./i| . By the Chernoff-inequality the probability that an / G 17 takes the value 1 more 
than (i + e)|T|-times or less than (i — e)|T|-times on the set T is less than 2 cxp(— |T|), 
where the positive constant Ce depends only on e. Therefore the probability that there exists 
a cylindric intersection set T C Xi^a of size at least e|Xi_^| for which / G takes the value 
1 more than (i + e)|T|-times or less than (i — e)|T|-times on the set T is less than 

2(l^d^-^)2'=2exp(-Cee|X,|^). 

Since \Xi\ < \X2\ < ... by the Borel-Cantelli lemma we have the following lemma. 

Lemma 2.5 For almost all f G Q there exist only finitely many i such that there exists at 
least one cylindric intersection set T c Xi^A for which / S f2 takes the value 1 more than 
(i- + €)\T\-times or less than {^^ — €)\T\-times on the set T. 

Now let us consider a cylindric intersection set Z C Xa, Z = DcccaZc, Zc S Xc- By 
the previous lemma, for almost all / e fi, 

i^isj nz) = -i,{Z) . 

■' n 

Therefore for almost all / G f2: 

M5)nz') = i(M^')), 

where Z' is a finite disjoint union of cylindric intersection sets in X^. Consequently, for 
almost all / G O, 

^iiS}nY) = -{^i{Y)), 

■' n 

where Y e cr(^)*. This shows immediately that E{Sj \ a-{A)*) = ^ for almost all / G O. 
Similarly, E{Sl \ a{A)*) = ^ for almost all / G thus our proposition follows. I 
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2.5 Independent Complement in Separable a-algebras 

Let ^ be a separable cr-algebra on a set X, and let be a probability measure on A. Two 
sub CT-algebras B and C are called independent if n C) = fi{B)fi{C) for every B G B 
and C e C We say that C is an independent complement of S in ^ if it is independent from 
B and {B, C) is dense in A. 

Definition 2.3 Let A > B be two a-algebras on a set X and let fi be a probability measure 
on A. A B-random k-partition in A is a partition Ai,A2, . . . , Ak of X into A-measurable 
sets such that E{Ai\B) = l/k for every i — 1,2, . . . , k. 

Theorem 5 (Independent Complement) Let A > B be two separable a-algebras on a 
set X and let ^ be a probability measure on A. Assume that for every natural number k there 
exists a B-random k-partition {Ai^fc, A2,fe, . . . , Afejt} in A. Then there is an independent 
complement C of B in A. (Note that this is basically the Maharam-lemma, see 

Proof. Let 81,82, ■■ ■ be a countable generating system of A and let Vk denote the finite 
Boolean algebra generated by 81,82, ■■■ ,8k and {^ijl* < j < k}. Let denote the 
atoms of Vk- It is clear that for every atom R G we have that E{R\B) < l/k because 
R is contained in one of the sets Ai^k, A2^k, ■ ■ ■ , Ak,k- During the proof we fix one B- 
measurable version of E{R\B) for every R. The algebra Vk is a subalgebra of Vk+i for 
every k and so we can define total orderings on the sets V^. such that if i?i , -R2 £ V^. with 
i?i < R2 and Rz,Ra G 'Pk+i '^ith R^ C Rx,Ri C R2 then R^ < i?4. We can assume 
that X^fleP* -^(-^i ^){^) — 1 for every element in X. It follows that for fc G N, x G X and 
A G [0, 1) there is a unique element R{x, \, k) G satisfying 

^ E{R\B){x) < A 

R<R{x,\,k) 

and 

E{R\B){x) > A. 

R<R(x,\,k) 

For an element R £ VI let T{R, A, fc) denote the set of those points x G X for which 
R{x, A, k) = R. It is easy to see that T{R, A, k) is ;B-measurable. Let us define the A- 
measurable set 8{X, k) by 

5(A,fc)= U {T{R,X,k)niUR,<„R2)) 
Rev-;: 

and 8'{X,k) by 

8'{X,k)= U {T{R,X,k)niUR,<RR2)). 
Revi 
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Proposition 2.3 (i) A - i < ^(^(A, k) \ B){x) < A for any x e X. 

(ii) Ifk<t, then S{X, k) C S{\, t) C S"(A, fc) . 

(iii) E{S'{\, k)\S{X, k) \ B){x) < i for any x <E X . 

Proof. First observe that 

A-i< E{R\B){x)<X, 

R<R{x,\,k) 

for any x £ X. Also, we have 
S{X,k)^ y {RnT{Ri,X,k)), S'{X,k)^ [j {RnT{Ri,X,k)). (1) 

R,RieV*,R<Ri RM.ieVl,R<Ri 

That is by the basic property of the conditional expectation: 

E{S{X,k)\B)^ EiR\B)xTiR,,x,k)- 
R.Riev;^,R<Ri 

That is 

EiSiX,k)\B){x)= Y E{R\B){x). (2) 

R<R{x,\,k) 

and similarly 

E{S'{X,k)\B){x)= E{R\B){x). (3) 

R<R(x,X,k) 

Hence (i) and (iii) follows immediately, using the fact that E{R' \ B) < ^ for any R' £ 'P^- 
Observe that for any R G V^, T{R, A, k) = UR>cR,R'ev^T{R' , A, t) . Hence 

IJ (i?nr(i?i,A,fc)) c IJ {R'nT{R[,x,t))c 

R,Ri£V;,R<Ri R',R{eV;,R'<R{ 

C IJ {RnT{Ri,X,k)) 

R,Ri£Vl,R<Ri 

Thus H]) implies (ii) . I 

Lemma 2.6 Let S{X) = \Jf^^S{X,k) . Then if X^ < Xi, then ^(As) < S'(Ai). 

Proof. Note that x G >5'(A2, k) if and only if x G -R2 for some R2 < R{x, A2, fc) . Obviously, 
R{x, X2,k) < R(x, Ai, fc), thus x G 5(Ai, fc). Hence ^'(Aa) C 5(Ai) I 

Lemma 2.7 E{S{\) \ B)^X. 

Proof Since xs(x,k) ^'^^''^ Xs(x), we have E{S{X, fc) | B) iJ(5(A) | B) That is by (i) 

of Proposition [23] i;(5(A) \B)=X. I 
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The last two lemmas together imply that the sets <S'(A) generate a cr-algebra C which is 
independent from B. 

Now we have to show that B and C generate A. Let S Vk for some fc G N. We say that 
S is an interval if there exists an element R G V^l such that S = Urj^<iiRi. It is enough to 
show that any interval S E Vk can be generated by B and C. 

Suppose that {rj^i be sets in {B,C) and ||£;(S' | B)~E{Tt \ B)f 0. Then fi{SATt) 
as t ^ 0, that is B and C generate S. Indeed, 



fiiSAT,)' = Wxs - XT„ f > mS I B) - E{T„ \ B)\\^ . 

So let t > fc be an arbitrary natural number. It is clear that S is an interval in Vt- For a 
natural number Q < d < t — \ \ct Fd denote the ;B-measurable set on which E{S\B) is in the 
interval [|, ^y^)- Now we approximate S by 

t-1 , 



r,= U(F,n5(-))e(e,C). 



i=0 



Lemma 2.8 For any x E X , 



\E{S\B){x)~E{T,\B){x)\<-. 



Proof. First note that by Proposition [2?3] (iii) 



E{S{'^)\B){x)-E{S{-^,t)\B){x) 



1 

< - , 
~ t 



Note that 



d=0 



E{T,\B){x)=Y^XfAx)E{S{-^)\B){x) 
Suppose that x £ F^- Then 



E{T, I B){x) - ^(^' I ^)(^ 



< 



On the other hand E{S \ B)ix) = T.r'<rE{R' \ B){x) and ^ < Y.r'<rE{R' \ B){x) < 
^ . That is 

\E{S\B){x)-E{Tt\B){x)\<^. I 
The Theorem now follows from the Lemma immediately. I 

Definition 2.4 Let (X,A,fi) be a probability space, and assume that a finite group G is 
acting on X such that A is G-invariant as a set system. We say that the action of G is free 
if there is a subset S of X with fi{S) = 1/|G| such that S^^ Cl S^^ = whenever gi and g2 
are distinct elements of G. 
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We will need the following consequence of Theorem [5l 

Lemma 2.9 Let A> B be two separable a-algebras on the set X and let ^ be a probability 
measure on A. Assume that a finite group G is acting on X such that A, B and /i are G 
invariant. Assume furthermore that the action of G on (X,B,^) is free and that there is a 
B-random k partition of X in A for every natural number k. Then there is an independent 
complement C in A for B such that C is elementwise G-invariant. 

Proof. Let S" e S be a set showing that G acts freely on B. Let A\s and B\s denote 
the restriction of A and B to the set S. It is clear that if {Ai,A2, . . . ,Ak} is a ;B-random 
fc-partition in A then {SDAi, Sr\A2, . . . , SnAk} is a S|s-randoni k partition in A\s- Hence 
by Theorem [S] there exists an independent complement Ci of B\s in A\s- The set 

C ^ {\J HS\H e C,} 

geG 

is a CT-algebra because the action of G is free. Note that the elements of C are G-invariant. 
Since E{Ug^cH^\B) = J2geG -^i-^\^\s)^ S^^ that the elements of C are independent 
form B. It is clear that {C,B) is dense in A. I 

2.6 Separable Realization 

In this section we show how to pass from nonseparable tr-algebras to separable ones. 

First note that the symmetric group Sk acts on the space X'' by permuting the coordi- 
nates: 

{xi,X2,...,Xky = (a;^-i(i),x^-i(2), . . . ,a;^-i(fc)) ■ 

The group also acts on the subsets of [k] and cr(A)" = (t(A^), where A"^ denotes the image 
of the subset A under n E Sk- We shall denote by Sa the symmetric group acting on the 
subset Sa- 

Definition 2.5 A separable realization of degree r on X*^ ,r < k is a system of atomless 
separable a-algebras {1{A) \ 9 ^ A C [k] , |^| < r} and functions {Fa : X'' — > [0, 1] | ^ 
j4 C [fc] , 1^1 < r} with the following properties 

1. 1{A) is a subset of a (A) and is independent from ^{A)* for every ^ A C [k]. 

2. 1{A)'^ — 1{A'") for every permutation n E Sk- 

3. for every S £ 1{A) and n e 5*^. 

4. Fa is an 1{A) -measurable function which defines a measurable equivalence between the 
measure algebras of (X.'^ ,1{A), jj,'') and [0,1]. (see Appendix) 

5. Fa{x) = FA^ix"^) for every element x G X'^ , tt G Sk and AC [k]. 
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The main theorem in this section is the following one. 

Theorem 6 For every H e ^([fc]) there exists a separable realization of degree k such that 
H is measurable in {1{A) \ ^ A C [k]). 

We will need the following three lemmas. 

Lemma 2.10 Let B A two a-algebras on a set X , and let /i be a probability measure on 
A. Then for any separable sub-a-algebra A of A there exists a separable sub a-algebra B of 
B such that E{A\B) = E{A\B) for every A e A. 

Proof. We use the fact that ^ is a separable metric space with the distance d{A,B) = 
li{A/\B). Let W = {£>i, £>2, • • •} be a countable dense subset of A with the previous 
distance. Let C^ ^ = E{Di \ B)~^{p,q), where p < q are rational numbers. Clearly, 
E{Di I B) is a Bj-measurable function, where Bi = {Cp g \ p < q £ <Q). Obviously, 
E{Di I B) = E{Di I B) for any i > 1, where B = {Bi \ i = 1,2, ...) . Now observe that 
E{Di I B) ^ E{D,B) if A ^ D. Hence for any D €A, E{D \ B) = E{D \ B). I 

Lemma 2.11 Let A C [k] be a subset and assume that there are atomless separable a- 
algebras d{{i}) C o({i}) ,i E A such that d({i})'^ = for every i G A and n G Sa- 

Then Sa acts freely on {d{{i})\i € A). 

Proof. The permutation invariance implies that there is a tr-algebra A on X such that 
P^^y{A) = d{{i}) for every i G A. Let F : X — > [0, 1] be a ^-measurable measure preserving 
map. Now we can define the map G : X"^ [0, 1]"^ by 

G{xi-^ , , ■ ■ ■ , ) := {F(xi-^ ), F{xi^), . . . , F(xi^j^^^ )). 

Let us introduce S' := {{xi,X2, ■ ■ ■ ,Xr)\xi < X2 < ■ ■ . < Xr} C [0, 1]"^ and S := G~^{S'). 
Clearly fi^{S) = 1/\A\\ and STi = <D for every two different elements w ^ pin Sa- I 

Lemma 2.12 Let k be a natural number and assume that for every A C [k] there is a 
separable a-algebra ciA) in a-{A). Then for every A C [k] there is a separable a-algebra 
d{A) in a{A) with c{A) C d{A) such that 

1. E{R\{d{B)\B e A*)) = E{R\a{A)*) whenever R e d{A). 

2. d{AY = d{A'^) for every element tv G Sk. 

3. d{B) C d{A) whenever BCA 

Proof. First we construct algebras d'{A) recursively. Let d'{[k]) be (c([/;;])'^|7r G Sk). Assume 
that we have already constructed the algebras d'{A) for \A\ > t. Let A C [k] be such that 
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\A\ = t. By Lemma [2TT0] we can see that there exists a separable subalgebra d'{A)* of <t{A)* 
such that E{R\a{A)*) = E{R\d'{A)*) for every R e d'{A). Since a{A)* is generated by 
the algebras {<j{B)\B G A*} we have that every element of cr(A)* is a countable expression 
of some sets in these algebras. This implies that any separable sub cr-algebra of <t{A)* is 
generated by separable sub cr-algebras of the algebras <t{B) where B E A* . In particular 
we can choose separable cr-algebras d'{A,B) D c{B) in (j{B) for every B E A* such that 
{d'{A,B)\B e A*) D d{A)*. For a set B C [fc] with \B\ = t - 1 we define d'{B) as the 
(T-algebra generated by all the algebras in the form of d'{C\ DY , where tt G 5^ , — B , 
\C\ = |D| + 1 and Dec. Since d'{C,DY C ct(L>)^ = a{B) we have that d'{B) C a{B). 
Furthermore we have that d' [BY =d' [B^) for every tt g Sk- 

Now let d{A) := {d'{B) \ B <Z A), the second requirement in the lemma is trivial by 
definition. We prove the first one. The elements of d{A) can be approximated by finite 
unions of intersections of the form Hbca '^b where Tb G d'{B) and so it is enough to prove 
the statement if R is such an intersection. Let Q = C\bcA b^a '^b- Now 

E{R\{d{B)\B e A*)) ^ E{R\{d'{B)\B c A,B A)) . 
By the basic property of the conditional expectation (see Appendix) : 

E{R\{d'{B)\B ciA,B^A))= E{TA\{d' {B)\B cA,Bj^ A))xq = E{TAW{Ar)xQ = 

= E{R\a{A)*). 

I 

Proof of Theorem[6] We construct the algebras 1{A) in the following steps. For each non- 
empty subset A C [fc] we choose an atomless separable cr-algebra c{A) C a (A) containing a 
CT(yl)*-random r-partition for every r. We also assume that H e c([fc]). Applying Lemma 
l2.12l for the previous system of separable cr-algebras c{A) we obtain the a-algebras d{A). By 
Lemma l2.11l and the permutation invariance property of the previous lemma, S[r] acts freely 
on c?([r])*. Hence using Lemma 12.91 for every 7^ A G [fc] we can choose an independent 
complement l{[r]) for (i([r])* ~ {d{B)\B G [r]*) in d{[r]) such that l{[r]) is element- wise 
invariant under the action of S^^]- The algebras l{[r]) are independent from cr([r])* since 
^(i?) = E{R\d{[r])*) = £'(i?|cr([r])*) for every R G l{[r]). Now we define 1{A), where 
\A\ = r by 1{A) = l{[r]Y for some tt G Sk, 7r([r]) = A. Note that 1{A) does not depend 
on the choice of tt. By Lemma 14.11 of the Appendix we have maps F^^] : X ^ [0, 1] such 
that F^^ defines a measure algebra isomorphism between A^([0, 1],B, A) and A^(X, l[r], fi). 
Let Fa = tt^^ o F^^^^-^, where tt maps [r] to A. Again, i^^^] does not depend on the particular 
choice of the permutation tt. I 
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Now let S = {^(^), ^A}0^yic[fc] be a separable realization of X and k < n he a, natural 
number. Let Be [n], \B\ = r < k and tt G S'n be a permutation that maps [r] to B. Let 
1{B) C X" be defined as ^([r])'^. If we choose a n' ^ Sn that also maps [r] into B then 
(tt)^^ o tt permutes [r] hence fixes l{[r]). Therefore 1{B) does not depend on the choice of 
TT. Let Fg defined as 7t~^ o F^^] . We have the following lemma. 

Lemma 2.13 The system S — {1(B), FB)iii=iBC[n].\B\<k is a separable realization of degree 
k on X". If B C [n], \B\ ^ r < k and f : [r] ^ B is a bijection then let pB ■ X."^ ^ X^ 
the natural projection and pf : X^'"! — > X^ is the natural isomorphism. Then 1{B) = 
PB^iPfmr])))- 

By Lemma 12.41 and Lemma 14.21 we have the following lifting lemma as well. 

Lemma 2.14 The map F : [0,1]^ , F — ®$^A<z[k]FA defines an isomorphism 

between the measure algebra of M(X.'^ , {1(A) | 7^ A C [fc]},/i) and the Lebesgue measure 
algebra M([0,lf~\B,X). Similarly, F : X" ^ [Q, F = ©0^scH,|s|<fc-FB 

defines an isomorphism between the measure algebra 7\/((X", {1(B) | 7^ i? C [n], \B\ < 
k),fi) and the Lebesgue measure algebra X([0, l]^'=i(*), A). 



3 Applications for Hypergraphs 

3.1 Hypergraph homomorphisms and convergence 

Recall that a fc-uniform hypergraph i7 is a system of k element subsets (edges) denoted 
by E(H) of a set V (node set). A fc-uniform hypergraph can be represented as a subset 
Sh C such that (xi,X2, ■ ■ - Xk) G S* if and only if {xi,X2, .. .jXk} £ E(H). Note that 
Sh is invariant under the action of Sk on . For any hypergraph we have an underlying 
(fc — l)-dimensional simplicial complex S(i/) consisting of the subsets of the fc-edges. 
Suppose that if is a finite fc-uniform hypergraph on the node set [n] := {1, 2, . . . , n} and H is 
a fc-uniform hypergraph on the node set V . Then a map / : [n] — > is a homomorphism 
if / maps edges to edges. If H is finite then hom(K, H) is the number of homomorphism 
from K to H. Denote by t(K, H) the probability that a random map g : [ri\ ^ V \s & 
(K, H) — homomorphism, that is 

^ ' ' 

If H is not necessarily finite then T(K, H) C V^" denotes the (K, _ff)-homomorphism set, 
where (xi, X2, ■ ■ ■ , x^) G T(K, H) if 1 xi,2 —>■ X2, . . . , n — > x„ defines a homomorphism. 
Clearly \T(K,H)\ = hom(K,H). Note that 

T(K,H)^ fl p^'(pf(SH)), 

EeE(K) 
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where / : [fc] — > i? is a bijcction (see Lemma [2TT4]) . 

Definition 3.1 We say that a sequence of k -uniform hypergraphs {Hi}°^^ is convergent 

if for every fixed finite k-uniform hypergraph K limi^cot{K, H) exists. 

Let {^ili^i be finite sets and Hi C be fc-uniform directed hypergraphs, that is a 
sequence of S'^.-invariant sets C is given. As in the Section 12.11 , let X be the 
uhrahmit of the sets Xi. Then H := [{5"/^. }^]^] C V{X'^) is the ultralimit hypergraph, 
an S'fc-invariant set corresponding to an actual hypergraph on the node set X . We can define 
its homomorphism set as 

T(if,H):= fl p^i(p;(H)). 

EeE(K) 

Then 

r(if,H) = [{T{K,Hi)}Z^] C 7'(X") . 

Clearly, /i"(r(isr, H)) = \m\^t{K,Hi), where /i" denotes the ultralimit measure on X". 
Thus if {Hi]°^i is a convergent sequence of hypergraphs then: 

/z"(T(i^,H)) = lim t{K,H,). 

i — 'rOO 

3.2 The Hypergraph Removal Lemma 

Lemma 3.1 (Infinite Removal Lemma) Let H be an Sk-invariant measurable subset 
of ~XJ^ . Then there exists an Sk-invariant nullset I C H such that for every k-uniform 
hypergraph K either T{K, H \ I) = or \T{K, H \ I)| > 0. 

Proof. Let us consider the separable realization iS of H and the corresponding measurable 
equivalence : X ^ [0, l]^''^^. For some Lebesgue measurable set Q C [0, 1]^''^^ we have 
that |F-i(g)AH| = 0. Since 

we may suppose that Q is S'^-invariant. By Lebesgue's Density Theorem, almost all points 
of Q are density points. Let D denote the (iSfe-invariant) set of density points in Q and 
let S F-^{D). Notice that the group Sk acts on [0,1]^ ^ the following way. Let 
Ai,A2, . . . , A2k_i be a list of non-empty subsets of [k]. Then 

iyAi,yA2,- ■ ■,yA^^_^Y = {y7T-\At),y-K-^{A2)^- ■ ■,y-n-HA.^^,_^)) ■ 

By the invariance property of the separable realization, the maps Fa commutes with the 

k ^ 

iSfe-action that is tt o Fa = Fa o n. Also, let Bi, ■ ■ . , Br , (r = X)i=i(0) be the list of 
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non-empty subsets of [n] of size at most k, then Sn acts on [0, l]*" by 

{yBi,VB2,- ■ -iVB^V = (y^-i(Si),2/7r-i(S2)' • ■ • >2/7r-i(B,)) • 

Again, by the invariancc property of the hfting p o Fb = Fb o p, for any B C [n], \B\ < k, 
p £ Sn- For i? C [ri], |_B| = fc a bijection f : [k] ^ B induces a measurable isomorpism 
Lf : [0, ^ [0,1]''(-^), where r{B) denotes the set of non-empty subsets of B. Let 

Lb ■ [0, 1]'' [0, be the natural projection. Then by the invariance property of the 
lifting 

PB^iPfi^")) = F-\L-^\Lji[0, if-'))) . (4) 
That is for any fc-regular hypergraph K 

T{K, S) = nEeEiK)PE\Pfi^)) = F~^nEeEiK)LE\Lf{D))) . 

Since each point of Z? is a density point, each point of L^'{Lf{D)) is a density point 
for any E e E{K). Thus f\EeE(K)L]^'^{Lf[D)) is either empty or is of positive measure. 
Consequently, T{K, S) is either empty or is of positive measure as well. Choosing I — H\S, 
we obtain that T{K, H\T) = T{K, H nS) is cither empty or is of positive measure (note 
that p.{T{K, iJ n S)) = fiiT{K, S)) and T{K, HnS)C T{K, S)) . I 

Theorem 7 (Hypergraph Removal Lemma) For every k-uniform hypergraph K and 
constant e > there exists a number S — S{K, e) such that for any k-uniform hypergraph H 
on the node set X with t{K,H) < 6 there is a subset L of E{H) with L < e('^') such that 

t{K,H\L)^o. 0/, m, m) 

Proof. We proceed by contradiction. Let K he & fixed hypergraph and e > be a fixed 
number for which the theorem fails. This means that there is a sequence of hypergraphs 
Hi on the sets Xi such that limi^oot{K, Hi) — but in each Hi there is no set L with the 
required property. Let us represent the hypergraphs by symmetric subsets Shi of X^ and 
again let H C X*-' denote the ultralimit of them. Then /i(T(ii:,H)) = \im^ t{K,H,) = 
and thus by the previous lemma there is a zero measure S*/; -invariant set I C X'^' such that 
T{K, H \ I) =0. By the definition of nuUsets, for any ei > there exists an ultralimit 
set J C X'' such that I C J and /i(J) < ei. We can suppose that J is S'^-invariant 
as well. Let [{Ji},^i] = J, then for w-almost all «, Ji is Sk- invariant, |J,;| < ei|Xi|''' and 
T{K, Hi\Li) — 0, where Li is the set of edges {xi, X2, . ■ . , Xk} such that (xi, X2, . . . , Xk) £ Ji- 
Clearly, \Li\ < \ Ji\, hence if ei is small enough then \Li\ < e('^') leading to a contradiction. 
I 
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t{K,W) := 



3.3 The Hypergraph Limit Object 

In this section we introduce the notion of hypergraphons (see |S] and [Tj for graphons) . 

Let W : [0,1]^ {0,1} be a Lebesgue measurable function. We caU such functions 

directed hypergraphons. As in the previous subsection we consider the 5fc-action on 
[0,1]^ and caU the S'^-invariant directed hypergraphons just hypergraphons. Now we 
introduce the homomorphism density of a hypergraph into a hypergraphon. Let K he a k- 
uniforni hypergraph and W : [0, 1]'^'^^^ — > M be a hypergraphon. Let Ck = {Ci, C2, . . . , Cs} 
be the set of non-empty elements of the simplicial complex of K. 
Example: li K = {{1, 2, 3}, {2, 3, 4}} then 

Ck = {{!}, {2}, {3}, {4}, {12}, {13}, {23}, {24}, {34}, {1, 2, 3}, {2, 3, 4}}. 

For each edge E e E{K) we fix a bijection se '■ [k] E. Then the homomorphism 
density of K in W is defined as 

Jo Jo Jo E^Ef^K) 

(5) 

Now let {Xi}^^ be finite sets and Hi be fc-uniform directed hypergraphs on Xi. Let 
H C X'^ be their ultralimit hypergraph. Let F : X'^ [0, 1]^ be separable realization 
and Q C [0, 1]2 -1 be a 5 fc-invariant measurable set such that fj.{F ^((3)AH)) = 0. Then 
we define Wn as the characteristic function of Q. Clearly, Wh is an hypergraphon. Now 
we can state our main theorem. 

Theorem 8 (Main Theorem) Let {Hi}°^i be a sequence of k-uniform hypergraphs as 
above and let K be a fixed k-uniform hypergraph on the vertex set [n]. Then 

lim t{K,H,)=t{K,Wii). 

UJ 

Proof. Applying the Equation Q we obtain that 

li[T{K,H) = Vol {nEeEiK)LE\Lf{Q))) . 

Hence 

^iiT{K, H)= [ I ... I n -^EdxB, dxB2 . ■ . dxB^ , 
Jo Jo Jo 



10 Jo Jo 

where is the characteristic function of i^^(i/((5)). Clearly, 



EeE{K) 

-1/ 



Since ri_Be£;(K) ^ e depends only on the variables associated to the elements of the simplicial 
complex of K, the Theorem follows. I 
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The following theorem is an immediate corollary of the previous one. 

Theorem 9 If {Hi}°^^ is a convergent sequence of k-uniform hypergraphs then there exists 
a2^ ~1 variable hypergraphon W such that limi—,oot{K, Hi) — t{K, W) for every k-uniform 
hypergraph K . 

Remark: One can introduce the notion of a projected hypergraphon Wn which is the 
projection of a hypergraphon to the first 2*^ — 2 coordinates, where the last coordinate is 
associated to [k] itself. That is 

Ww.{xAt,XA2,---,XA^k_^)= / Wu^{xA^,XA2,---,XA^t_^)dXA^k_-,- 

Ja 

That is Wii is a [0, l]-valued function which is symmetric under the induced S'^-action of 
its coordinates. By the classical Fubini-theorem we obtain that using the notation of the 
previous theorem: 

lim,i^oot{K, Hi) = 

1 

W Wli{XsE(Ai),XsE{A2), ■ ■ ■ ,XsE(A^k_2))^^CldXC2 ■ --dXCt , 

EeE(K) 

where Ci, C2, . . . , Ct is the list of the at most k — 1-dimensional simplices in K. Note that 
in the case fc = 2 it is just the graph limit formula of [6]. 

3.4 The Hypergraph Regularity Lemma 

First we need some definitions. Let X be a finite set, then Kr{X) denotes the complete 
r- uniform hypergraph on X. An /-hyperpartition 7i is a family of partition Kr{X) = 
^'j=iP^, where P^? is an r- uniform hypergraph, for 1 < r < fc. We call 7i (5-equitable if for 
any 1 < r < fc and 1 < i < j < I'. 

\Kr{X)\ ^ ■ 

An /-hyperpartition 7i induces a partition on Kk{X) the following way. 

• Two elements a,b £ Kk{X), a — {ai, 02, . . . , flfe}, b — 62, ■ ■ • , ^fe} are equivalent 
if there exists a permutation a G Sk such that for any subset A — {ii < 22 < . . . < 
VI } ^ {a^i'Oia, . . . ,ai|^|} and ^^(i^), . . . are both in the same P^^^ 

for some 1 < j < I. 

It is easy to see that this defines an equivalence relation and thus it results in a partition 
Uj=iCj of Kk{X) into 7i-cells. A cylinder intersection L C Kr{X) is an r-uniform 
hypergraph defined the following way. Let Bi, i?2,. • . i?r be r — 1 uniform hypergraphs on 
AT, then an r-edge {oi, 02, . . . , a^} is in L if there exists a permutation t £ Sr such that 

{ao-(i) , aCT(2) , • ■ • , 0(7(1-1) , 0(7(1+1) , • ■ • acr(r) } £ Bi . 
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As in the graph case, we call an r-uniform hypergraph G e-regular if 



\G\ 



\Gr\L\ 



\Kr{X)\ 



for each cylinder intersection L, where \L\ > e\Kr{X)\ . Now we are ready to state the 
hypergraph regularity lemma for fc-uniform hypergraphs (see [2], [1], [9], |11|V 

Theorem 10 (Hypergraph regularity lemma) Let fix a constant k > 0. Then for any 
e > and F : N (0; 1) there exists constants c — c{e,F) and iVo(e, -F) such that if H 
is a k-uniform hypergraph on a set X, \X\ > Nq^s^F), then there exists an F (I) -equitable 
l-hyperpartition Ti for some \ < I < c such that 

• Each Pj is F{1) -regular. 



Proof. Suppose that the Theorem does not hold for some e > and F : N (0, 1). That 
is there exists a sequence of fc-uniform hypergraphs Hi without having i^(j)-equitable j- 
hyperpartitions for any I < j < i satisfying the conditions of our Theorem. Let us consider 
their ultralimit [{5//.}^]^] = H C X'^. Similarly to the proof of the Removal Lemma we 
formulate an infinite version of the Regularity Lemma as well. 

Let _ft'r(X) denote the complete r-uniform hypergraph on X, that is the set of points 
{xi,X2, . ■ . ,Xr) S X'' such that Xi ^ Xj if i ^ j. Clearly Kr(X.) C X*" is measurable and 
/i[r](ii'r(X)) — 1. An r-uniform hypergraph on X is an S'j.-invariant measurable subset of 
Kr(X.). An Z-hyperpartition is a family of partitions Kr(X.) — U^^j^pj , where P^. is an 
r-uniform hypergraph for 1 < r < fc. Again, an /-hyperpartition induces a partition of 
Kk(X.) into 7i-cells exactly the same way as in the finite case. It is easy to see that each 
H-cell is measurable. 

Proposition 3.1 (Hypergraph Regularity Lemma, infinite version) For any e > 0, there 
exists a 0-equitable l-hyperpartition (where I depends onH) Ti. .such that 

• Each PJ is in a{[r])* . 

• /i[fc](ifAT) < e, where T is a union of some TL-cells. 

Proof. Let 5 be a separable realization for H and Q C [0, 1]^ be an S'fc-invariant subset 
such that (F~^(Q)AH) = 0. Since Q is a Lebesgue-measurable set, there exists some 
/ > such that Vol2k_i{QAZ) < e, where Z is a union of /-boxes. Recall that an /-box is 
a product set in the form 




where T is the union of some TL-cells. 
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By the usual symmetrization argument we may suppose that the set Z is invariant under the 
Sfe-action on the /-boxes. Since the measure of points (a;i, a;2, . . . , ) ^ [0' ^ such that 
Xs — Xf for some s ^ t is zero, we may also suppose that in each box in Z, is ^ it if s ^ t. Let 
Z = Ul^^iOrm where Om is an S'i:-orbit of boxes. That is Om ~ U7re5j.7r(D) for some /-box 
D. By the previous condition 7ri(£') ^ tt2{D), if tti ^ tt2, hence each 0^ is the disjoint union 
of exactly fc! /-boxes. Then ^[k]{F-^{Q)AF-^{Z)) < e, where F-^{Z) = U^„=ii^"HO,n) • 
For each 1 < r < A; we consider the partition X'' ~ u'^j^pj , where pj = j-) . 

We call the resulting /-hyperpartition H. Note that by the 5r-invariance of the separable 
realization each P{ is an r-uniform hypergraph and also pj E a{[r])* . 

Lemma 3.2 C is an Ti-cell if and only if C = F^^{UTreSk^{D)), where D is an l-box in 

Proof. By definition (ai, 02, • . . , ctfe) £ X*^ and (61, 62, • • ■ , ^fc) G are in the same Ti- 
cell if and only if there exists n such that for any A C [k] {ai-^,ai^, . . . ,ai^^^) and 
{bi^^i) , ■ • ■ ' ^i,r(|A|)) ^^'^ same PJ . That is F/i(ai, 02, ... , a/j) and 
-Fk(&;T(i), (^7r(2)j • ■ ■ J (&7r(fe) ^rc in the same /-box. I 

Since /i[fe](i7A U^^j^ i^^^(Om)) < o^^' Proposition follows. I 

Now we return to the proof of the Hypergraph Regularity Lemma. First pick an r- 
hypergraph PJ on X such that ^[,,](pj APJ) = 0, PJ G V[r\ and U^-^iPJ = i^r(X). Let 
[{Sp3 }tLi] = Pi - Then for t^-almost all indices U^=iP/,, = Kr(X,) is an i^(/)-equitable 
/-partition and ji/^A U'^^j^ < e for the induced Ti-cell approximation. Here U^^^j^C^n 
is the Ti-cell approximation with respect to the /-hyperpartitions U^^j^pj = /^^(X) and 

The only thing remained to be proved is that for cj-almost all indices i the resulting /- 
hyperpartitions are i^(/)-regular. If it does not hold then there exists 1 < r < fc and 
1 < i < ^ such that for almost all i there exists a cylinder intersection Wi C Kr{Xi)., 
\W^\ > e\X,\, such that 

> e . (6) 



\Kr{X,)\ \W^\ 

Let W = [{Swi}^i]- Then W C UBc[r]<^iB). Hence P{ and W are independent sets. 
However, by ^ 

MH(Pi)A^H(W)y^A'H(PiuW), 
leading to a contradiction. I 
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4 Appendix on basic measure theory 

In this section we collect some of the basic results of measure theory we frequently use in 
our paper. 

Separable measure spaces: Let {X, A, fi) be a probability measure space. Then we call 
A, A' G A equivalent if fi{AAA') = 0. The equivalence classes form a complete metric 
space, where [_B]) = fi{AAB) . This classes form a Boolean-algebra as well, called 

the measure algebra A4 {X, A, ii) . We say that {X, A^ ^) is a separable measure space if 
Ai{X, A, fi) is a separable metric space. It is important to note that if {X, A, /i) is separable 
and atomless, then its measure algebra is isomorphic to the measure algebra of the standard 
Lebesgue space ([0, l],B, A), where B is the cr-algebra of Borel sets (see e.g. [3]. We use the 
following folklore version of this theorem. 

Lemma 4.1 // {X,A,^j.) is a separable and atomless measure algebra, then there exists a 
map f : X ^ [0,1] such that f^^{B) C A, ^(/"^(C/)) \{U) for any U e B and for any 
L A there exists M G B such that L is equivalent to f^^{M). 

Proof. Let lo denote the interval h — Then let /o,o = Io,i — [j; 5]) 

— [jjflj h,i — Recursively, we define the dyadic intervals Iai,cx2.---,ak-i where 

(ai, a2, . . . , Qffc) is a — 1-string. Let T be the Boolean-algebra isomorphism between the 
measure algebra of {X, A, n) and the measure algebra of ([0, 1], B, A). Then we have disjoint 
sets Uo,Ui G A such that T{[Uo]) = [Iq], T{[Ui]) = [h]. Clearly /i(X\(C/o U Ui) = 0. 
Similarly, we have disjoint subsets of Uq, C/0,0 and C/0,1 such that T([[/o,o]) = [^0,0] and 
T{[Uo^i]) — [Io,i]- Recursively, we define Uai,a2,...,a^ £ -4 such that Uai,a2,---,ak-ifl and 

Uai,a2,...,ak-i,Q are disjoint and T([C/cti.Q2 a^]) — Iai,a2,...,ak- The set of points in X 

which are not included in some C/qi. 02, for some fc > has measure zero. Now define 

where for each /c > 1, p G C/qj, 02, ■ It is easy to see that / satisfies the conditions of our 
lemma. I 

Generated u-algebras: Let (X, C,/i) be a probability measure space and Ai,A2,--- ,Ak be 
sub-cr-algebras. Then we denote by {Ai | 1 < « < fc) the generated cr-algebra that is the 
smallest sub-cr-algebra of C containing the AiS. Then the equivalence classes 

[u^^i(AinA^2n...nAi)], 

where A'^ G A and (A^ n n . . . ("1 Al) {A\r\ A\r\ . . . f] Al) = $ ii s ^ t form a dense 
subset in the measure algebra M.{X, {Ai \ 1 < i < k), fj,) with respect to the metric defined 
above (see |3]). 
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Independent subalgebras and product measures: The sub- cr- algebras Ai,A2,---,Ak C C 
are independent subalgebras if 

ii{Ai))^{A2) . . . ii{Ak) = niAi n ^2 n . . . n Afe) , 

if Ai G A- 

Lemma 4.2 Let Ai,A2,---,Ak C C be independent subalgebras as above and fi : X ^ 
[0, 1] be maps such that f^^ defines isomorphisms between the measure algebras A4{X, Ai, jj) 
and A^([0, 1],B, A). Then the map F~^, F = ©-Li/j : X —>■ [0, 1]'' defi.nes an isomorphism 
between the measure algebras M{X, {Ai \ 1 <i < k),iJ,) and A1([0, 1]'^, B*^, A''). 

Proof. Observed that 

s 

H{F-\UU[A\ X ... X AI])) = ^ A'^iAl X . . . X 

i=l 

whenever {A\ x . . . x are disjoint product sets. Hence F~^ defines an isometry 

between dense subsets of the two measure algebras. I 

Radon- Nykodyni Theorem: Let {X, A, ^) be a probability measure space and v be an ab- 
solutely continuous measure with respect to //,. That is if /i(^) = then ^{A) = as well. 
Then there exists an integrable ^measurable function / such that 

H{A) = / /d/i 

J A 

for any A& A. 

Conditional expectation: Let (X, A, jS) be a probability measure space and B C ^ be a sub- 
c7-algebra. Then by the Radon-Nykodym-theorem for any integrable ^measurable function 
/ there exists an integrable S-measurable function E{f \ B) such that 

/ E{f\B)d^l= [ fdiJL, 

J B J B 

if -B G B. The function E{f \ B) is called the conditional expectation of / with respect to 
B. It is unique up to a zero-measure perturbation. Note that if a < f{x) < b for almost 
all X €: X, then a < E{f \ B){x) < b for almost all x & X as well. Also, if 5 is a bounded 
B-measurable function, then 

E{fg I B) = E{f I B)g almost everywhere. 

The map / E{f, B) extends to a Hilbert-space projection E : L'^{X, A, ji) — > L^iX, B, /z). 

Lebesgue density theorem: Let A e M" be a measurable set. Then almost all points x G A 
is a density point. The point a; is a density point if 

Vol{Br{x)r\A) _ 

r™ Vol{Brix)) ' 

where Vol denotes the n-dimensional Lebesgue-measure. 
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